Embedding Words and Senses Together via Joint Knowledge-Enhanced Training

نویسندگان

  • Massimiliano Mancini
  • José Camacho-Collados
  • Ignacio Iacobacci
  • Roberto Navigli
چکیده

Word embeddings based on neural networks are widely used in Natural Language Processing. However, despite their success in capturing semantic information from massive corpora, word embeddings still conflate different meanings of a word into a single vectorial representation and do not benefit from information available in lexical resources. We address this issue by proposing a new model that jointly learns word and sense embeddings and represents them in a unified vector space by exploiting large corpora and knowledge obtained from semantic networks. We evaluate the main features of our approach qualitatively and quantitatively in various tasks, highlighting the advantages of the proposed method with respect to state-of-the-art wordand sense-

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Embedding Senses via Dictionary Bootstrapping

This paper addresses the problem of embedding senses of a plain word according to its context. Natural language is inherently ambiguous, due to the presence of many multi-sensed words. Such ambiguity might have undesirable influence over many text-mining tools, including word embedding. Traditional word embedding techniques have focused on identifying which words tend to co-occur with one anoth...

متن کامل

Neural Embedding Language Models in Semantic Clustering of Web Search Results

In this paper, a new approach towards semantic clustering of the results of ambiguous search queries is presented. We propose using distributed vector representations of words trained with the help of prediction-based neural embedding models to detect senses of search queries and to cluster search engine results page according to these senses. The words from titles and snippets together with se...

متن کامل

Combining Word Embedding and Lexical Database for Semantic Relatedness Measurement

While many traditional studies on semantic relatedness utilize the lexical databases, such as WordNet or Wikitionary, the recent word embedding learning approaches demonstrate their abilities to capture syntactic and semantic information, and outperform the lexicon-based methods. However, word senses are not disambiguated in the training phase of both Word2Vec and GloVe, two famous word embeddi...

متن کامل

Solving Verbal Questions in IQ Test by Knowledge-Powered Word Embedding

Verbal comprehension questions appear very frequently in Intelligence Quotient (IQ) tests, which measure human’s verbal ability including the understanding of the words with multiple senses, the synonyms and antonyms, and the analogies among words. In this work, we explore whether such tests can be solved automatically by the deep learning technologies for text data. We found that the task was ...

متن کامل

Joint Learning of Sense and Word Embeddings

Methods for learning lower-dimensional representations (embeddings) of words using unlabelled data have received a renewed interested due to their myriad success in various Natural Language Processing (NLP) tasks. However, despite their success, a common deficiency associated with most word embedding learning methods is that they learn a single representation for a word, ignoring the different ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017